A GENERALIZATION OF THE PROBABILITY THAT THE COMMUTATOR OF TWO 
GROUP ELEMENTS IS EQUAL TO A GIVEN ELEMENT 



AHMAD M.A. ALGHAMDI AND FRANCESCO G. RUSSO 

Abstract. The probability that the commutator of two group elements is equal to a given element has been intro- 
, duced in literature few years ago. Several authors have investigated this notion with methods of the representation 

^s^J ■ theory and with combinatorial techniques. Here we illustrate that a wider context may be considered and show some 

structural restrictions on the group. 

I—* 

in 

1. Different formulations of the commutativity degree 

Given two elements x and y of a group G, several authors studied the probability that a randomly chosen 
1 commutator [x,y] of G satisfies a prescribed property. P. Erdos and P. Turan [5] began to investigate the case 
[x,y] = 1, noting some structural restrictions on G from bounds of statistical nature. Their approach involved 
combinatorial techniques, which were developed successively in [21 HI El LZ1 El EH E3 EH Ell E3 and extended to 
the infinite case in [8jE2Ei]. On another hand, P. X. Gallagher [11] investigated the case [x,y] — 1, using character 
theory, and opened another line of research, illustrated in [31 HI E3 Ell EI] • The literature shows that it is possible 
to variate the condition on [x,y] involving arbitrary words, which could not be the commutator word [x, y]. From 
l— "™ '■ now, all the groups which we consider will be finite. 

| Given two subgroups H and K of G and two integers n,m > 1, we define 

f , ,i Mm »v^\ ..,x„,yi,.. .,y m ) G H" x K m \ [xi, . . . , x n , y 1} . . . , y m ] = g}\ 

Tt ! (L1) P 9 ( H > K >= \JJ\u \ K \ m 

m . i i i i 

, as the probability that a randomly chosen commutator of weight n + m of H x K is equal to a given element of G. 
^> Denoting 

g I (1.2) A = {{x x , ...,x n ,yi,.. .,y m ) G H n x K m \ [x x , . . . ,x n ,y x , . . . ,y m ] = g}, 

\A\ = \H\ n ■ \K\ m ■ p^' m) (H,K). The case n = m = 1 can be found in [4] and is called generalized commutativity 
degree of G. For n = m = 1 and H = K = G, 

%\ (i.3) p a4) (G| ^ = Pg(G0= K(gjOi^lM^ 

■ is the probability that the commutator of two group elements of G is equal to a given element of G in [16] . 

It is well known (see for instance [U Excercise 3, p. 183]) that the function ip(g) = \{{x, y) G G x G \ [x,y] = g}\ 
is a character of G and we have ip = "7TT^' wnere Irr(G) denotes the set of all irreducible complex characters 

of G. However, the authors exploited this fact in [TBI Theorem 2.1], writing (|1.3p as 

1 ' X eIrr(G) AV > 

For terminology and notations in character theory we refer to [14] . 
Now for g = 1, 

n « {^) !r n\ <n\ *m l{(^y)£G 2 | [x, y ] = i}\ |lrr(G)| 
(1.5) pi (G, G) = pi (G) = d(G) = = 
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is the probability of commuting pairs of G (or briefly the commutativity degree of G), largely studied in [21 13 El 
El El El EH HB [El DSl EH HZl . In particular, 

(1.6) pi ,M) (G,G) = ■ • ■ . ^ ^jljJ^ - • - ' x "' x "+d = 111 = d (")(G), 
is the n-th nilpotency degree of G in [21 [31 El HE] and that 

(1.7) p^^G) = K^i.-.^.^e^xGI [x 1 ,..., a;m ,i / ] = l}| = d(n){H>G) 

\H\ n |G| 

is the relative n-th nilpotency degree of _ff in G, studied in [71 [T7I 118] . We may express (jl.7p not necessarily with 
g = 1; assuming that H is normal in G, [H Equation (4) and Theorem 4.2] imply 

(1-8) P.' ^ \WW\ x <t {G) X(D X(5) ' 

where Xir denotes the restriction of x to and (, } the usual inner product. Our purpose is to study (jl.lj) . extending 
the previous contributions in [21 21 [7J 1161 117] . The main results of the present paper are in Section 3, in which the 
general considerations of Section 2 are applied. 

2. Technical properties and some computations 
We begin with two elementary observations on (|l.ll) . 

Remark 2.1. If S = {[xi, . . . , x n , yi, . . . , y m ] \ Xi, . . . , x n G H; y%, . . . , y m G K}, then pg"' m) (iJ, K ) = if and only if 
.9 5. On another hand, p^' m) (H, if) = 1 if and only if [H, . . . , H, K, . . . , If] = [ n H, m K] = 1. 

n — times m— times 

Remark 2.2. The equation (JTTTJ) assigns by default the map 

(2.1) p("' m > : (x 1 ,...,x n ,y 1 ,...,y m )GH n xK m ^p^ m \H,K) e [0,1], 

which is a probability measure on H n x K m , satisfying a series of standard properties such as being multiplicative, 
symmetric and monotone. 

The fact that (|2.ip is multiplicative is described by the next result. 

Proposition 2.3. Let E and F be two groups such that e G E, f G F, A,C < E and B,D < F. Then 

pfc%\A x C,B x D)=pt m) (A,B).pf' m) (C > D). 

Proof. It is enough to note that 

]), ([&i, . . . , 6 m ], [di, . . . , d m ])] = ([[oi, . . . , a n ], [h, b m }], [a, c„], [di, dm]]). 

□ 



Proposition 12.31 is true for finitely many factors instead of only two factors and this can be checked with easy 
computations. Therefore the proof is omitted. The fact that (]2.1[) is symmetric is described by the next result. 

J,n,m) (T j ^ _ ^(n,m) ( 

G, then p<?> m \H,K) = p^' m) (K,H) = p^?\H,K). 



Proposition 2.4. With the notations of (II. lj) . p g n ' m (H, K) = p^™'™ (K , H ) . Moreover, if H , or K , is normal 



Proof. The commutator rule [x, y] 1 = [y, x] implies the first part of the result. Now let H be normal in G, n < m and 
B = {(yi, . . . , y m ,x%, ■ ■ .,x n ) G K rn xH n \ [y x , . . . , y m , xi, . . . , x n ] = g}. The map ip : (xx, . . . , x n , 2/1, ■ • ■ ,y m ) G A h-> 
y2~ 1 > ■ • • > 2/n \ ■ ■ ■ ,Vm iViXiVi 1 ,V2X2V2 1 , ■ ■ ■ , VnXnVn 1 ) £ B is bijective and so the remaining equalities 
follow. A similar argument can be applied, when the assumption H is normal in G is replaced by K is normal in 
G. " ' □ 



The fact that (|2.ip is monotone is more delicate to prove, since this is a situation in which we may find upper 
bounds for (11. ip . Details are given later on. Now we will get another expression for p. II) . With the notations of 
(|l.ip . Clff([a:i, . . . ,x n ]) denotes the K-conjugacy class of[xi,... ,x n ] G H. 
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Proposition 2.5. With the notations of 



\H\ n \K\ 

1111 x lt ...,x n eH 

B- 1 [<oi,---,<o»]e01/ f ([«i,. ...on]) 



Proof. It is straightforward to check that 

(2.3) CtfrnQzi, . . .,i n ]) = C K ([xi, ■ • ■ ,x„]) x ... x C K ([xi,. . .,x n ]) 



in— times 



In particular, \C K ™,([xi, . . . ,x n ])\ = \C K {[x\, ■ ■ ■ , x n ])\ m . 

•A = U {[xi,...,x n ]} x T [a;i) ... )Xn] , where T [xii _ iXn] = {(y 1} . . . , y m ) € K m \ [xi,.. .,x n ,yi, ...,y m ] = s}- 



[ii,...,i„]ejj 



Obviously, T[ Xu ... <Xn ] ^ if and only if 3 1 [a;i, . . . ,x n ] 6 Cljc([a;i ) . . .,x n ]). Let T^...^] ^ 0. Then (T^, 



|Cifm([xi, . . . ,x n })\, because the map ip : [y x , . . . , y m ] i-> g[yi, . . . ,y m ] [yi, . . .,y m ] is bijective, where [yi, . . .,y m ] is 
a fixed element of Tr Xlj- „ )X 1. We deduce that 

I-4 =E[x 1 ,...,^„]£ff I = E |cVm([a;i,...,x„])| 

xi , ... 7 x n £H 

(2.4) 

E (^([xr,...,^])!" 1 

xi,.. .,x n £H 

g~ 1 [^li-i^n]^Ol K ([x ll ... 1 x n ]) 

and the result follows. □ 

Special cases of Proposition 12.51 are listed below. 
Corollary 2.6. in Proposition [53] , if m~l and G — K, then 

(2.5) p (n.i)( ff ,G) = 1 ^ j i|^ J] ICcaxr,...,^])!. 

I I I I x!,...,x n eH 

B -1 [*i.---.en]eoi G ([a>i,...,» n ]) 

Corollary 2.7 (See [4], Theorem 2.3). In Proposition 12.51 . if m = n = 1, then 

(2-6) ^) {H ,K) = -^— Y, 1^)1- 

1111 xeH 

g- 1 xeCl K !.x) 

In particular, if G = K, then pg^(H,G) = \ H \ \ G \ \Cg{x)\. 

Corollary 2.8 (See [7 , Proof of Lemma 4.2). In Proposition ^. 51 . ifm = l and G = K, then 

(2.7) v[ n *\H,G)=dW{H,G) = — 1— 1 X! ICg^i,...,^])!. 

' ' ' 'xi,...,x n eH 

Corollary 2.9. In Proposition 12.51 . i/ CkQxi, . . . ,x n ]) — 1> then 

(2-8) Pi"' m) (JT, K) = -L + 1 _ —J— . 

v ; Pl 1 ' y |#|™ |if| m \H\ n \K\ m 

[U Proposition 3.4] follows from Corollary 12.91 when m = n = 1. 

Remark 2.10. Equation (| 1 . T[) makes equivalent the study of p^™' 1 ^^, G) and that of d^ n \H,G). This is illustrated 
in Corollary 12.81 and noted here for the first time. Therefore there are many information from [2] [JJ [9j [17] and 
[4] [3] [16] which can be connected. It is relevant to point out that these concepts were treated independently and 
with different methods in the last years. 
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Let X be a character of G and 9 be a character of H < G. The Frobenius Reciprocity Law [IH Lemma 5.2] gives a 
link between the restriction xh of \ to H and the induced character 9 G of 8. Therefore (x, g )g = {xh, 0)h- Write 
this number as S( Xt g) = {x^ G )g — (xh,0)h- If e {xfi) = 0, then does not appear in xh and so x does not 
appear in 9 G . Recall from [14] that, if e.{ x ,6) 7^ 0, then x covers 8 (or also 9 belongs to the constituents of xh)- 
In particular, if = xh, then e( XiXfJ ) = (x, {xh) G )g — (xh,Xh)h- From a classic relation (see [HI Lemma 2.29]), 
e (x,Xff) = (X) (Xh) G )g = (xh,Xh)h <\G : H\ (x,x)g = |G : H"|e (x , x ) and the equality holds if and only if x(x) = 
for all x G G — -ff. In particular, if x G Irr(G), then (xij, Xh)h = \G : H\ if and only if x( x ) — 0, for all x G G — H. 
Therefore the following result is straightforward. 

Corollary 2.11. With the notations of pg 1 ' 1 ^!?, G) < |G : H\ pi(G) and £/ie equality holds if and only if all 

the characters vanish on G — H . 

At this point, [4] Theorem 4.2] becomes 
(2.9) C(9) = \H\ ^5fr-^9) = \{{x,y)eHxG\[x,y]=g}\= £ |G G (x)|, 

g-i^eci G (x) 

where C(g) is the number of solutions (x,y) £ H x G of the equation [a;, y] = g. Note that (|2.9j) and [TJ Excercise 3, 
p. 183] give a short argument to prove that ((g) is a character of G with respect to the argument in [4j Corollary 
4.3]. The equation (|1.8p becomes 



(2.10) pi M) (#,G) 



,(1,1) (EI CO*) 

For the general case that n > 1, m > 1 and G = K . 



\H\ \G[ 



(2.11) p(n,-) ( ^ G) = i_^ = __( ^ a^Dr), 



£1 ,...,x n £H 

ff- I [*l.---.*n]eCl G r([a>i, 



where 



(2.12) C ( "' m) (9)= £ 



, . . . , u> n I 



a: i , . . . , x n G H 

B- 1 [«i,...,»!n)601 G r([o> I m„]) 



is the number of solutions (xi, . . . , x n , yi, ■ ■ ■ , y m ) G IT™ X G m of [x%, . . . , x„, j/i, . . . , y m ] = g. 
Remark 2.12. There are many evidences from the computations that £(™> rn )(g) is a character of G. 
Now we may prove upper bounds for (|l.ip and find that (|2.1|) is monotone. 

Proposition 2.13. With the notations of (jl.ip , i/i? < .K", then Pg' m \H,G) > \^' m \K,G). The equality holds if 
and only if Q\h(x) = C\k(x) for all x G G. 

Proof. We note that t^t < rgr an d then < tjjtk- By Proposition 12.51 



\ G r-p { r n) (K,G) = v ± w e icgc^x 

a: i , . . . , £ n G 

ff- l [«l,...,»n]€01 G ([n!i,. ..,*„]) 



, . . . , u^nj 



(2.13) 

< ]^pr E |G G ([xi,...,a; n ] 



xx,. ...x n £K 

g-l[x 1 ,...,x„]eCl G ([x 1 ,...,x, l ]) 



in particular the last relation is true for x\, . . . , x n G H < K and continuing 
(2.14) =-j- £ G G ([a;i, . . . , x n ])| = |G| m • p^ l ' m ^(H, G). 



H 

1 1 xi,...,x„eH 

fl-M^i »n]6Cl G ([»!,. ..,«„]) 



The rest of the proof is clear. □ 
The next result shows an upper bound, which generalizes |7J Theorem 4.6]. 
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(n,m) , 



Proposition 2.14. With the notations of (11. if N is a normal subgroup ofG such that H < N, then p g n,m (H, G) < 

N ' N / 

Proof. We have 



Pg (-j^,^). Moreover, if N n [ n H m G\ = 1, £/ien £/ie equality holds. 



\H\ n \G\ m 


p<?< m \H,G) = \A\ 










= \{(xx,.. 


■ ,x n ,yi, ■ ■ ■ ,y m ) e H n x 


G m 


| [sci,...,x n ,yi,...,j/ m ] -i? -1 


= 1}| 


= \{(xx,.. 


•,x„,yi,...,?/ m ) 6 H n x 


G m 


| [aci, . . . ,x„,2/i, . . . jT/™^" 1 ] 


= 1}| 


= Enen 


• ' ^2x n £H X/jdGG ' " 




-i EG 


C G ([a;i,...,a:„,yi,...,y m ]) 




= Hues 


• ■ J2x n £H J2 yi £G ■ ■ 






|Cf G ([a;i,...,a;„,wi,...,l/m])JVHC7 J f([a;i, 


..,a„,Ki,...,3/m])| 


,GG 


|JV| 




— SxiGff 


■ ■ J2x n £H J2 yi £G ■ ■ 


. v 

^yr 


,£G 


C G/Ar ([x 1 JV,...,x T ,i\r,yiJV,.. 


,y m N})\ 


• Cjv([xi, . 


■ ■ j ^nj yi j ■ • ■ ) 2/m] ) | 











— ^SiEH/N S Ki gSi ■ • ■ J2s„€H/N Sx„gS„ StiGG/N S ai GTi ■ ■ ■ £t„,GG/JV J2y m £T m 

\C g /n([Si,- ■ .,S n ,Ti, . . . ,T m ])\ ■ \C N ([xi, . . -,y m ])\ 

= (SsieH/Af ■ • ■ J2s n eH/N StieG/w • ■ ■ Y^T m eG/N \^g/n{[Si, ■ ■ ■ , S n ,Ti, . . . ,T m ])\ 

■(ExiGS! • ■ -J2x n eS n SyiGTi ■ ■■H Vm eT m \Cn{[xi, ■ ■ ■ ,Z/m])|) 

— |A r | rt+m y5 ieff /jv • ■ • EsneH/N StiGG/JV • ■ • Er,„GG/« 
Cg/a'(['S'i, ■ ■ ■ , S n , Ti, . . . , T m ])| 

_ H n G m An,m) ( H g\ I jyln+m _ I rrln Ir 1 !™ rS n ' m ^ ( H G \ 

— N N Pa \N'NJ l iV l — l-"l M Pfl \N'NJ- 

The condition of equality in the above relations is satisfied exactly when AT n [ n H, m G] = 1. The result follows. □ 
Corollary 2.15. ^4 special case of Proposition l2~T4l p s (G) < p g (G/N). 

Corollary 2.16 (See [7], Theorem 4.6). In PropositiondUl , ifm = 1 and g = 1, then S n 1 (H , G) < S n 1(H/N,G/N). 

3. Some upper and lower bounds 
A relation among (|l.ip - (|1.8p is described below. 
Theorem 3.1. With the notations of ([TT]) . p 3 "' m) (G,G) < p^' ro) (if, K) < p[ n ' m) (H,K) < p[ n ' m) (H,G) < 

Proof. From Proposition [2T31 p^' m) (G,G) < p g n ' m) {G,H). From Proposition 
(3- 1 ) P^ m) (H,K)= 1 ^ |C7 K ([*i, 



1111 li,...,I„£H 

S- 1 [a> 1 ,...,a>n]601 K C[a !1) ...,«>„]) 



and for g = 1 we get 

(3-2) < imn \^ m E |^([x 1 ,...,x„])r=p^(JJ ; if), 



let n uq ; 

1111 x 1 ,...,x n eH 



where in the last passage still Proposition 12.51 is used. From Ck([%i, • • ■ , x n ]) C Gg([xi, . . . , x„]), we deduce 
(3.3) < \C G ([xi,...,x n ))\ m =pt m \H,G). 
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Applying PropositionEH p^' m) (H, G) = p^ n ' ro) (G, H) and so p["' m) (G, H) < p[ n ' m) (H, H) by Proposition!!! □ 
Corollary 3.2. With the notations of ([11]), if Z(G) = 1, then p g nA) (H,K) < 21=1. 

Proof. It follows from Theorem 13.11 and Theorem 5.3]. □ 

Another significant restriction is the following. 
Theorem 3.3. With the notations of (|l.ip . let p be the smallest prime divisor of \G\. Then 
(i) $'™\ H ,K) 

cm n( n ^"Vf/ k\ > (i-p)|yffi+p|g"i (\K\+ P )\c H (K)r . 

w/iere Y H n = {[xi, . . . , x„] £ if™ | Ck{[x\, . . . ,x n ]) = 1}. 

Proof. If [„i?, m K] = 1, then CH™(K m ) = H n and Yj/n equals H n or an empty set according as K m is trivial or 
nontrivial. Assume that [ n H, m K] ± 1. Then Y H n n Cjjn(i^ TO ) = Y H „ n {C H (K m ) x ... x G ff (A m )) = n 
{C H (K) x Off (If) x ... x Ch(X)) = Y H n n (G ff (A))' im ^ and 

E ICx-azi,...,^])^ E \C K ([ Xl ,...,x n })\ m 

xi,...,x n EH xi,...,x n £H 

E |c if ([x 1 ,...,x n ])| m + e iCjfdxi,...,!^!"* 

xi,...,a:»eVH'> Ki,...,a:„eCH»(K) 

(3.4) 

+ e \c K ([ Xl ,...,x n ])r 

H,...,a;„eff»-(y I ,nUCjfn(ff)) 

= |Y ff „| + |tf| |Cfc(A-)|"+ E ICK-an,...,^])!" 1 . 



Since p m < \C K ([ Xl ,...,x n })\ m < HLJ \Y H n\ < \H n \ and p" < |G ff (A)|" < Jf^, 



(3.5) < \Y Hn \ + \K\ \C H (K)\ n + (\H n \-(\Y Hn \ + \C H (K)\ n )-^ 

p" 1 

and then 
(3.6) 



P s I,-", -"J S rmq i^rrxi -t- rjpn i 



< 



| |ff m | ~ |ff" | |ff™| ~ p m p m |ff"| p m |ff"| 

1 1 1 _ 2p"+p-2 



p m ' pm + Ti — 1 y pm pm + n pm + n pm + n 

Hence (i) follows. On another hand, we may continue in the other direction 

(3.7) >\Y Hn \ + \K\ \C H (K)\ n +p(\H n \-(\Y Hn \ + \C H (K)\ n ) 

and then 

Then (ii) follows. □ 
The bound in Theorem l3.3l (i) is a little bit different from the bound in (4J Corollary 3.9], where it is proved that 

l 

Ps 



• 1 ' X \H,K) < 2p 2 1 and in particular pg 1 '(H,K) < §. We conclude the following structural restriction. 



Corollary 3.4. In Theorem [H if p { g n m) (H, K) = 2p ' p \tl^ 2 , then 



p n+l _ p 3 _ P_ +p 



(3.9) l^:C ff (A)|< v v+p 2 

Proof. Looking at p.6[) and the proof of Theorem 13.31 (i), we deduce 

2p"+p-2 < it \Yh*.\ + \K\\C H (K)r 



V 



(3.10) 

'2 _,_ \ C H (K) i n 



1^" I l^ m l ^ |ff"l |ff m l P" 



Cjf(ff) 
ff 



1 
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and then < § 



Ch(K) 
H 



We conclude that 2p ^ +p _ 9 > f + 



H 



C H (K) 



and so 



The result follows, once we extract the n-th root. □ 



(3 11) - _ = . _ £ £1 > 

v ' ' 2p™ + p - 2 2 2p 2 +p-2 
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